TITLE OF THE INVENTION 
FINDER, MARKER PRESENTATION MEMBER, AND PRESENTATION 
METHOD OF POSITIONING MARKER FOR CALIBRATION 

PHOTOGRAPHY 

CROSS-REFERENCE TO RELATED APPLICATIONS 
This application is based upon and claims the 
benefit of priority from the prior Japanese Patent 
Application No. 2002-308640, filed October 23, 2002, 
the entire contents of which are incorporated herein by 
reference . 

BACKGROUND OF THE INVENTION 
1. Field of the Invention 

The present invention relates to a finder suitable 
for use in photographing an object whose shape or 
surface attribute is known in order to acquire a camera 
parameter, a marker presentation member, and a 
presentation method of a positioning marker for 
calibration photography. 

2. Description of the Related Art 
To carry out correct three-dimensional 
measurement, a calibration board (pattern) whose shape 
is known has heretofore been photographed to calculate 
an inner parameter of an optical system. As one 
example, in Jpn. Pat. Appln. KOKAI Publication 
No. 2002-202122, a mode has been proposed in which the 
calibration board (pattern) and the optical system are 
disposed on the same parallel rails to maintain 
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predetermined relative positions when photographing the 
calibration board (pattern) . 

BRIEF SUMMARY OF THE INVENTION 
According to a first aspect of the present 
5 invention, there is provided a finder apparatus which 

is used together with a photographing apparatus, 
comprising: 

a finder configured to present an image of 
a subject so as to be visually recognizable by 
10 an operator; and 

positioning marker presentation member configured 
to present a marker for positioning for setting 
relative positions of the photographing apparatus and 
an object for calibration to the finder so as to be 
15 visually recognizable by the operator, when the object 

for calibration including at least one of a known shape 
and a known surface attribute is photographed to 
acquire a parameter of a photographing optical system 
of the photographing apparatus. 
20 According to a second aspect of the present 

invention, there is provided a marker presentation 
member comprising one of: 

a member through which a visible light is 
transmitted and on which a marker for positioning is 
25 partially disposed to set relative positions of 

a photographing apparatus and an object for calibration 
including one of a known shape and surface attribute; 
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and 

a member including the marker for positioning, 
wherein 

the one of the member on which the marker for 
5 positioning is disposed and the member including 

the marker for positioning is disposed on an optical 
path of a light which guides the image of the object 
for calibration into the operator's eyes, when 
photographing the object for calibration in order to 
10 acquire parameters of a photographing optical system of 

the photographing apparatus . 

According to a third aspect of the present 
invention, there is provided a method for presenting 
a marker for positioning for calibration photography, 
15 comprising: 

presenting an image of an obj ect for calibration 
in a finder which guides the image photographed by 
a photographing apparatus into operator's eyes so as to 
be visually recognizable by an operator, when 
20 photographing the object for calibration whose one of 

shape and surface attribute is known in order to 
acquire parameters of a photographing optical system of 
the photographing apparatus; and 

presenting a marker for positioning to set 
25 relative positions of the photographing apparatus and 

the object for calibration in the finder so as to be 
visually recognizable by the operator. 
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According to a fourth aspect of the present 
invention, there is provided a finder apparatus which 
is used together with a photographing apparatus, 
comprising: 

5 a finder for presenting an image of a subject so 

as to be visually recognizable by an operator; and 

positioning marker presentation means for 
presenting a marker for positioning for setting 
relative positions of the photographing apparatus and 
10 an object for calibration to the finder so as to be 

visually recognizable by the operator, when the object 
for calibration including at least one of a known shape 
and a known surface attribute is photographed to 
acquire a parameter of a photographing optical system 
15 of the photographing apparatus. 

Advantages of the invention will be set forth in 
the description which follows, and in part will be 
obvious from the description, or may be learned by 
practice of the invention. Advantages of the invention 
20 may be realized and obtained by means of the 

instrumentalities and combinations particularly pointed 
out hereinafter. 
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 
The accompanying drawings, which are incorporated 
25 in and constitute a part of the specification, 

illustrate embodiments of the invention, and together 
with the general description given above and the 
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detailed description of the embodiments given below, 
serve to explain the principles of the invention. 

FIG. 1 is a diagram showing an example of 
an object for calibration; 
5 FIG. 2 is a diagram showing another example of 

the object for the calibration; 

FIG. 3A is a diagram showing another example of 
a calibration pattern; 

FIG. 3B is a diagram showing that an object to be 
10 photographed is disposed on the calibration pattern 

shown in FIG. 3A; 

FIG. 4 is a diagram showing an optical finder of 
a photographing apparatus as a first embodiment of the 
finder of the present invention; 
15 FIG. 5 is a diagram showing a structure example of 

the finder in a two-lens system in the first 
embodiment; 

FIG. 6 is a diagram showing a structure example of 
the finder in a single lens reflex system in the first 
2 0 embodiment; 

FIG. 7 is a diagram showing a panel as a marker 
presentation member according to the first embodiment; 

FIG. 8A is a perspective view of a perforated 
member; 

25 FIG. 8B is a front view of the perforated member 

shown in FIG. 8A; 

FIGS. 9A to 9E are diagrams showing shape examples 
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of positioning markers; 

FIG. 10 is a diagram showing a photographing 
situation of the calibration pattern by a photographing 
system which is a photographing apparatus according to 
5 a second embodiment of the present invention; 

FIG. 11 is a block diagram showing a constitution 
of the photographing system which is the photographing 
apparatus according to a third embodiment of the 
present invention; 
10 FIG. 12 is an explanatory view concerning 

a thickness of a protective panel on an electronic 
finder; 

FIG. 13 is a flowchart showing a display operation 
of the positioning marker in a sixth embodiment of the 
15 present invention; 

FIG. 14 is a diagram showing the photographing 
situation of the calibration pattern by the 
photographing system which is the photographing 
apparatus according to an eighth embodiment of the 
20 present invention; 

FIG. 15 is a flowchart showing an operation for 
informing a user of a deviation in the eighth 
embodiment; 

FIG. 16 is a diagram showing the photographing 
25 situation showing another example of description 

concerning photography; 

FIG. 17 is a diagram showing the photographing 



situation showing still another example of the 
description concerning the photography; 

FIG, 18 is a diagram showing the photographing 
situation of the calibration pattern by the 
photographing system which is the photographing 
apparatus according to a ninth embodiment of the 
present invention; 

FIG. 19 is a concept diagram of stereo 
photography; 

FIG. 20A is an explanatory view of a constitution 
of an optical path splitting optical system in a stereo 
adapter; 

FIG. 20B is a front view of the photographing 
system including the stereo adapter; and 

FIG. 21 is a diagram showing the photographing 
situation of the calibration pattern by the 
photographing system including the stereo adapter, 
which is the photographing apparatus according to 
a tenth embodiment of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

First an object for calibration whose shape and/or 
surface attribute is known will be described prior to 
detailed description of embodiments of the present 
invention . 

As the object for calibration, a plate-shaped 
object in which a known geometrical pattern is 
described can be used. For example, the object for 



calibration shown in FIG. 1 (hereinafter referred to as 
a calibration pattern 10a) can be used. In this 
example, three types of large, medium, and small black 
circles are drawn at constant equal intervals and with 
a certain rule. These intervals and rule depend on 
algorithm of calibration, required photographing system 
correction information, and the like, and can 
arbitrarily be selected, and are not limited in the 
present invention. For example, the black circles may 
be replaced with cross marks, or double circles 
constituted of white and black. Instead of distinction 
with the size of the black circle, distinction may also 
be made with color information. 

In the present specification, the terms "object 
for calibration" and "calibration pattern" mean 
an object that is known in terms of at least shape 
or surface attribute. The size of the object need not 
be known, depending on the parameter to obtain. 
The term "surface attribute" is not limited to such 
a geometrical pattern. It may mean also the color or 
pattern data of the surface of the object. The surface 
pattern may be defined by holes made in or other 
objects bonded to the surface of the object. The other 
objects are of a color or colors different from that of 
the object. 

Furthermore, as the object for calibration, 
the above-described plate-shaped objects may also be 
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combined. For example, the object for calibration 
shown in FIG. 2 (hereinafter referred to as 
a calibration pattern 10b) can be constituted. It is 
to be noted that in this figure the known geometrical 
5 pattern is constituted of the cross mark, but needless 

to say, the above-described other patterns may also be 
used. 

The object for calibration (calibration pattern 
10a or 10b) is photographed, and internal parameters of 

10 an optical system such as lens strain information can 

be acquired from the obtained image. Moreover, when 
predetermined image correction is performed based on 
the acquired lens strain information, it is possible to 
acquire, for example, an image from which lens strain 

15 is removed. 

Moreover, when an object to be photographed is 
photographed, as shown in FIG. 3B, an object to be 
photographed O is disposed on a calibration pattern 10c 
shown in FIG. 3A, and photographed to acquire various 

20 parameters. In this manner, the photographing of 

the calibration pattern in a system for acquiring 
information from an image has also broadly been 
performed. 

Embodiments of the present invention will 
25 hereinafter be described with reference to the 

drawings . 
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[First Embodiment] 

The present embodiment is an example in which 
a marker for positioning is presented to appropriately 
set relative positions of a photographing apparatus and 
5 the object for calibration in a finder. It is to be 

noted that in the present specification, an apparatus 
for guiding the image of a subject into operator's eyes 
so that a photographing range can be presented to 
an operator is referred to as the finder. In addition 

10 to the optical finder, a so-called electronic finder 

for presenting the photographing range to the operator 
via electric apparatuses such as LCD is also included. 
Furthermore, in the present specification, the term 
"image" means an optical image and/or electronic image. 

15 That is, to acquire various parameters of 

a photographing optical system of the photographing 
apparatus, the calibration pattern which is the object 
for calibration having the known shape or surface 
attribute is photographed by the photographing 

20 apparatus. At this time, in a finder 12 of the 

photographing apparatus, as shown in FIG. 4, the marker 
for positioning (markers for positioning 14a in this 
example) with respect to the calibration pattern for 
use (the calibration pattern 10a shown in FIG. 1 in 

25 this example) is presented so as to be visually 

recognizable. Therefore, as shown in FIG. 4, 
a photographing person who looks into the finder 12 



sees the image of the calibration pattern (calibration 
pattern image 10a f in this example) superimposed 
upon the markers for positioning (markers for 
positioning 14a) . 

As a method of presenting the marker for 
positioning, a presentation method by the optical 
superimposition of images is proposed. An example of 
this optical image superimposition will be described 
with reference to FIGS. 5 and 6. 

In the photographing apparatus of a two-lens 
system, as shown in FIG. 5, an outside light taken in 
via a diffusion plate 16 passes through a glass plate 
18, which is a member analogous to the markers for 
positioning (e.g., markers for positioning 14a) and 
constitutes a marker image production section, to 
produce an image of the marker for positioning. 
The image of the marker for positioning passes through 
a mirror 24 and optical path adjustment lens 26, and is 
superimposed upon the image of the subject from 
an objective lens 20 by a half mirror 22 as an image 
superimposition section. Moreover, the superimposed 
image enters user's eye 28 via an eyepiece lens 30. 
In this manner, the glass plate 18 which is the member 
analogous to the marker for positioning is disposed on 
an optical path 32 of a light, for guiding the image of 
the subject into the operator eye 28, and accordingly 
the marker for positioning can be presented. 
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Therefore, the diffusion plate 16, the glass plate 18, 
the half mirror 22, the mirror 24 and optical path 
adjustment lens 26 constitute a positioning marker 
presentation member 81. 
5 Moreover, in a single lens reflex photographing 

apparatus, as shown in FIG . 6, the image of the subject 
from the objective lens 20 is reflected by a movable 
mirror 34, passes through the glass plate 18 which is 
the member analogous to the marker for positioning 

10 (e.g., the markers for positioning 14a), and is 

superimposed upon the image of the marker for 
positioning. Furthermore, the superimposed image 
passes through a prism 36 and the eyepiece lens 30 and 
enters the user's eye 28. In this manner, even in the 

15 single lens reflex photographing apparatus, the glass 

plate 18 which is the member analogous to the marker 
for positioning is disposed on the optical path 32 of 
the light, for guiding the image of the subject into 
the operator's eye 28, and accordingly the marker for 

20 positioning can be presented. Provided on the optical 

path 32, the glass plate 18 functions as a positioning 
marker presentation member 81 that works as a marker 
image production section and an image superimposition 
section. It is to be noted that reference numeral 38 

25 in FIG. 6 is an image pickup device. 

Since a user may use the marker for positioning 
(e.g., the markers for positioning 14a) as a clue to 



photograph calibration pattern (e.g., the calibration 
pattern 10a) , it is easy to grasp the calibration 
pattern in an appropriate view field of the 
photographing apparatus. It is also possible to 
calculate a substantial distance between the 
photographing apparatus and the calibration pattern 
from a relation between the calibration pattern and 
the marker for positioning during the positioning. 
Furthermore, a plurality of places (e.g., the pattern 
of the calibration pattern image 10a 1 superposed upon 
a cross portion of the markers for positioning 14a in 
FIG. 4) where the calibration pattern is positioned 
with the marker for positioning are set. Accordingly, 
the calibration pattern can easily be photographed from 
a plurality of distances. 

It is to be noted that in the known photographing 
apparatus (camera) , an auto focus frame and a 
photographing range frame are presented on the finder. 
However, the former indicates a range in focus (place 
to be focused) , and the latter indicates an actually 
photographed range. Therefore, since the marker for 
positioning does not follow the object (the known shape 
of the object for calibration, arrangement of patterns) 
in the finder of the present embodiment, the marker 
cannot be used for the positioning. 

It is to be noted that, needless to say, it is 
possible to variously modify/change each constitution 
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of the present embodiment. For example, instead of 
taking in the outside light from the diffusion plate 
16, the marker for positioning may be presented in 
a self-luminous system in which LED, and the like are 
5 used as a light source, or a transmission type LCD, 

and the like may also be used instead of the glass 
plate 18. Marker images may also be images of a 
plurality of LED. When the LED or transmission type 
LCD is turned on/off, or the optical path 32 for 

10 guiding the marker image into the photographer's eye 2 8 

is cut off, the image of the marker for positioning can 
be brought in a display/non-display state, or can be 
allowed to blink. 

Alternatively, the marker for positioning may also 

15 be drawn or printed on the front surface or the back 

surface of the finder 12 so as to be visually 
recognizable. A film or panel 40 on which the marker 
for positioning (a marker for positioning 14d 
corresponding to the calibration pattern 10b shown in 

20 FIG. 2 in this example) shown in FIG. 7 is disposed and 

through which the visible light is transmitted may be 
attached to the finder 12 so that the marker for 
positioning is visually recognizable. Alternatively, 
a configuration of a thin seal through which the 

25 visible light is transmitted may also be provided and 

attached to the finder 12. 

Alternatively, as shown in FIGS. 8A and 8B, 
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a perforated member 42 as the marker for positioning 
through which the visible light is transmitted may also 
be attached to the finder 12 in accordance with the 
shape or the surface attribute of the object for 
5 calibration (calibration pattern (calibration pattern 

10b shown in FIG. 2 in this example) ) . In this case, 
the object for calibration may be photographed so that 
the image of the object (calibration pattern image 10b 1 
in this example) is within a view field range. When at 

10 least an outer frame of the view field can be 

recognized, the positioning is possible even in a state 
in which the marker is not completely visually focused. 
Therefore, as compared with a case in which a member 
including a linear marker as shown in FIGS. 9A to 9E is 

15 attached, there is an advantage that limitation of 

an attaching position is loose. 

Moreover, when the photographing apparatus 
includes an electronic finder having a function of a 
monitor for confirming the image except the finder 12, 

20 the marker for positioning may also be disposed only on 

the finder 12. In this constitution, the marker 
does not constitute any hindrance, when the once 
photographed image is confirmed or when. a purpose of 
the photography is not the calibration. 

25 Furthermore, the shape of the marker for 

positioning does not have to be a linear shape shown in 
FIG. 4. For example, as shown in FIGS. 9A to 9E, any 
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mark may also be used, as long as the mark is a clue to 
the photographing of the calibration pattern. That is, 
as the marker for positioning, line segments, 
intersecting line segments, points, curves, 
5 intersecting curves, or closed curves are disposed, and 

the followings are considered: 

• a marker indicating a closed region 
corresponding to a contour of the image of the 
calibration pattern shown in the finder in a state in 

10 which the relative positions of the photographing 

apparatus and the object for the calibration pattern 
are appropriately set; 

• a marker indicating at least a corner position 
of the closed region corresponding to the contour of 

15 the image of the calibration pattern displayed in the 

finder, or surrounding an outer edge of the closed 
region in a state in which the relative positions of 
the photographing apparatus and the object for the 
calibration pattern are appropriately set as shown in 

20 FIG. 9C, or FIGS. 10, 14, 16, 17 described later in 

detail ; 

• a marker indicating a characteristic point of 
the image of the calibration pattern displayed in 

the finder in the state in which the relative positions 
25 of the photographing apparatus and the object for the 

calibration pattern are appropriately set; 

• a marker indicating a central point of 
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the calibration pattern as shown in FIG. 9A or 4; 

• a marker indicating a joint between the 
surfaces of the calibration pattern as shown in FIG- 9E 
or 7; and 

5 • a marker indicating arrangement of 

characteristic surface attribute of the calibration 
pattern as shown in FIG. 18 described later in detail. 
[Second Embodiment] 

The present embodiment is an example in which the 
10 present invention is applied to the photographing 

apparatus including displays such as LCD or the 
so-called electronic finder. 

As shown in FIG. 10, the markers for positioning 
(markers for positioning 14b in this example) with 
15 respect to the calibration pattern (calibration pattern 

10b in this example) are disposed, for example, printed 
on an electronic finder 46 which is the display of 
a photographing system 4 4 which is the photographing 
apparatus according to the second embodiment. Needless 
20 to say, the marker for positioning may also be disposed 

by the other method described above in the first 
embodiment . 

In this constitution, as described above in 
the first embodiment, the calibration pattern is 
25 photographed so that the image (calibration pattern 

image 10b" in this example) of the calibration pattern 
in an image 48b displayed in the electronic finder 4 6 
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is aligned with the marker for positioning disposed on 
the electronic finder 46. Accordingly, the appropriate 
calibration pattern is easily photographed. 

Moreover, since the image photographed in this 
5 manner can be displayed in the electronic finder 4 6 in 

the constitution of the present embodiment, it can be 
judged whether or not the image including the 
calibration pattern grasped in the appropriate view 
field of the photographing system has been 
10 photographed, before carrying out calculation for 

acquiring actual parameters. 
[Third Embodiment] 

The present embodiment is an example in which the 
marker for positioning is electrically superimposed 
15 upon an output image to the electronic finder and 

output . 

As shown in FIG. 11, the photographing system 44 
which is the photographing apparatus according to the 
third embodiment includes a photographing optical 

20 system 50, optical finder (finder optical system) 52, 

image pickup device 38, storage device 54, input device 
56, control device 58, and electronic finder 46 which 
have constitutions similar to those of a general 
photographing apparatus. Here, the photographing 

25 optical system 50 forms the image of a subject in a 

predetermined position, and the image pickup device 38 
converts the subject image formed by the photographing 
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optical system 50 into image data to output the data. 
The optical finder (finder optical system) 52 presents 
a photographing range to an operator. The storage 
device 54 stores image data output from the image 
5 pickup device 38. The input device 56 operates the 

photographing system 44. The control device 58 
controls storage or reproduction of the image data with 
respect to the storage device 54 . The electronic 
finder 4 6 displays the image data output from the image 

10 pickup device 38 or reproduced from the storage device 

54 in accordance with the control of the control 
device 58. Furthermore, in the present embodiment, in 
addition to these general constitutions, a marker 
presentation device 60 is included. For the marker 

15 presentation device 60, during the photographing of the 

calibration pattern in which at least one of the size, 
shape, and surface attribute is known in order to 
acquire various parameters of the photographing optical 
system 50, the image of the marker for positioning is 

20 electrically drawn/superimposed upon the image data 

which is output from the image pickup device 38 and 
which is to be displayed on the electronic finder 46. 

In this constitution, when the drawn marker for 
positioning is used as the clue to photograph the 

25 calibration pattern, it is easy to grasp the pattern in 

an appropriate view field of a camera. 

Moreover, when the marker for positioning is 
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disposed on the surface of the electronic finder 46, as 
shown in FIG. 12, it is proposed that a transmission 
panel 62 (usually transparent glass or plastic) be 
disposed in order to protect the electronic finder 46. 
5 In this case, because of thickness of the transmission 

panel 62, the position of the marker for positioning 
deviates depending on an angle at which the user views 
the electronic finder 46. However, in the electronic 
drawing as in the present embodiment, since the 

10 deviation is not generated, it is easy to grasp the 

calibration pattern in a further appropriate view field 
of the photographing system. It is to be noted that 
the photographing system 44 may display the image 
directly in the electronic finder 4 6 from the image 

15 pickup device 38 not via the storage device 54. 

[Fourth Embodiment] 

In the third embodiment, the marker for 
positioning is constantly superimposed and constantly 
displayed by the marker presentation device 60. 

20 However, in accordance with a user's desire, that is, 

the user uses the input device 56 for operation at the 
time of the photography so that display/non-display of 
the marker for positioning can be selected. 

When the display/non-display of the marker for 

25 positioning can be selected in this manner, for 

example, when it is selected not to display the marker 
for positioning at the time of the photography not 
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carried out for a purpose of calibration, the marker 
for positioning can be prevented from constituting any 
hindrance . 

[Fifth Embodiment] 
5 When the transmission type LCD, and the like are 

used instead of the glass plate 18 in the first 
embodiment, or when the marker for positioning is 
displayed in the electronic finder 46 as in the third 
and fourth embodiments, the display of a marker for 

10 positioning 9 may be allowed to blink. 

When this blink display is carried out, the marker 
for positioning is conspicuous, and therefore the 
positioning is further facilitated. In this case, in 
the same manner as the presence/absence of the display 

15 of the marker for positioning in the fourth embodiment, 

the presence/absence of this blink display operation 
can also be selected by the user using the input 
device 56. 

[Sixth Embodiment] 

20 In the fourth embodiment, the user selects the 

display/non-display of the marker for positioning. 
However, in the present embodiment, in accordance with 
switching between a calibration pattern photographing 
mode and a usual photographing mode, the display/non- 

25 display of the marker for positioning is automatically 

selected, that is, the marker for positioning is not 
displayed at the time of the usual photographing. 
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It is to be noted that here the usual photographing 
means the photographing of the object whose shape and 
surface attribute are unknown and may also include 
photography for a purpose of acquiring three- 
5 dimensional information of the subject, and photography 

by projection of the pattern onto the subject. 

That is, as shown in FIG . 13, when a calibration 
pattern photographing mode is turned ON (step Sll), the 
marker for positioning 9 is superimposed/displayed upon 

10 the electronic finder 46 (step S12) . 

The switching between the usual photographing mode 
and the calibration pattern photographing mode may be 
carried out by the operation of the input device 56, or 
may automatically be carried out. The automatic 

15 switching can be carried out, for example, by 

automatically judging, by image processing, whether or 
not the photography is a first photography of the day, 
the image is recorded in the storage device 54, or the 
photography is the first photography after an adapter 

20 is attached (in an adapter system) (e.g., from contrast 

or presence of a repeated pattern, it is recognized 
that the calibration pattern is photographed. 

In this constitution, at the time of the usual 
photographing, the pattern can be photographed without 

25 being hindered by the marker for positioning. 

[Seventh Embodiment] 

In the third embodiment, by the marker 
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presentation device 60, the marker for positioning is 
constantly superimposed and accordingly constantly 
displayed. However, when the photographed image stored 
in the storage device 54 is reproduced and displayed in 
5 the electronic finder 46, the marker for positioning 

may not be displayed. Here, the photographed image is 
an image once stored after the subject is photographed, 
and is not synchronized with the image from the image 
pickup device 38. 

10 That is, when the control device 58 judges that 

the image is read from the storage device 54, the 
marker for positioning is not displayed at the time of 
image confirmation. In this constitution, the marker 
for positioning does not constitute any hindrance at 

15 the time of the image confirmation. 

Moreover, when the user uses the electronic finder 
4 6 to confirm the photographed image after the 
photography, the input device 56 for the operation may 
also be used to select the display/non-display of the 

20 marker for positioning. In this case, the marker for 

positioning can be displayed only on a necessary image 
so that the image can be confirmed. 
[Eighth Embodiment] 

FIG. 14 is a diagram showing the photographing 
25 situation of the calibration pattern by the 

photographing system 44 which is the photographing 
apparatus according to an eighth embodiment of the 
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present invention, and FIG. 15 is an operation 
flowchart of the photographing system 44. 

That is, when the calibration pattern 
photographing mode for photographing the calibration 
5 pattern (calibration pattern 10b in this example) is 

turned ON in the photographing system 44 including the 
electronic finder 46 (step S21), the control device 58 
controls the marker presentation device 60 to 
superimpose/display the marker for positioning (markers 

10 for positioning 14b in this example) upon an image 48b 

displayed in the electronic finder 46 (step S22) . 
Moreover, in the present embodiment, the control device 
58 carries out a process of recognizing the calibration 
pattern from the image 48b to calculate positional 

15 deviation between the recognized image of the 

calibration pattern (calibration pattern image 10b" 
in this example) and the marker for positioning 
(step S23) . Furthermore, in accordance with the 
calculation result, description concerning the 

20 photography (explanatory note 64A in this example) is 

superimposed/displayed on the image 48b of the 
electronic finder 46 (step S24) . Examples of the 
explanatory note 64A include characters indicating 
a direction for moving the photographing system 44 or 

25 the calibration pattern which is the subject or 

a photographing method. In this constitution, the 
positioning is further facilitated. 
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It is to be noted that, needless to say, each 
constitution of the present embodiment can variously be 
modified/changed. For example, instead of the control 
device 58, an external calculation device 66 connected 
5 to photographing system 44 as shown in FIG. 14 

calculates the positional deviation, and the 
calculation result may be received by the control 
device 58 to display the description concerning the 
photography. Furthermore, the description concerning 

10 the photography may also be displayed on a monitor of 

the photographing system 44 separate from the 
electronic finder 46 on which the marker for 
positioning is displayed, or on an external display 
connected to the photographing system 44. The 

15 calculation device 66 may include the monitor to 

display the description concerning the photography in 
the monitor. The input device 56 may also be used by 
the user to select the display/non-display of the 
description concerning the photography. Furthermore, 

20 the user may use the input device 56 to select the 

display of either one of the marker for positioning 
and the description concerning the photography. 
The description concerning the photography is not 
limited to the explanatory note 64A, and may also be 

25 an explanatory symbol 64B or 64C indicating the 

direction for moving the photographing system 44 or 
the calibration pattern as shown in FIG. 16 or 17. 
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Furthermore, the description may also be made 
concerning the photography not only by the character 
and symbol but also by sound navigation. 
[Ninth Embodiment] 
5 A ninth embodiment of the present invention is an 

example in which an object to be photographed is 
disposed on the calibration pattern. That is, as shown 
in FIG. 18, when an object to be photographed 0 
disposed on the calibration pattern (calibration 

10 pattern 10c shown in FIG. 3A in this example) is 

photographed by the photographing system 44 including 
the electronic finder 46, the markers for positioning 
(markers for positioning 14c in this example) are 
electronically superimposed/displayed on an image 48c 

15 displayed in the electronic finder 46. 

In this constitution, the user uses the 
superimposed/displayed markers for positioning 14c as 
the clue to photograph the object. Accordingly, it is 
easy to grasp the object to be photographed O disposed 

20 on the calibration pattern 10c in the appropriate view 

field of the photographing system. When the object to 
be photographed O is photographed from multiple 
directions, circumferential bonding processing is 
carried out, and it is therefore possible to easily 

25 photograph a satisfactory image having no leakage. 

[Tenth Embodiment] 

The present embodiment is an example in which the 
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marker for positioning is presented to the user, when 
the object for calibration is photographed by a stereo 
photographing apparatus. It is to be noted that in the 
present specification, "the stereo photographing" means 
5 the photographing from a plurality of points of sight. 

Furthermore, the photographing by one photographing 
apparatus using a stereo converter to obtain the image 
from the plurality of points of sight, or the 
photographing by the use of a plurality of 

10 photographing apparatuses is also included. The "image 

obtained by the stereo photographing" means the image 
from the plurality of points of sight. This also means 
a plurality of images from a plurality of photographing 
apparatuses, or one image in which the images from the 

15 plurality of points of sight are buried. 

Moreover, as a method of acquiring three- 
dimensional information in non-contact, there is stereo 
measurement. In this method, the images from different 
points of sight are acquired, and the three-dimensional 

20 information is obtained from a positional relation 

among the respective points of sight and a difference 
in a visible way among the respective images. 
For example, as shown in FIG. 19, a plurality of 
photographed images 70R, 70L are acquired from a 

25 plurality of points of sight (two points in this case) 

by photographing systems 68L, 68R, and one of the 
images is obtained as a standard image 72 (the left 
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photographed image 70L in this case) . Moreover, from 
an amount of difference (hereinafter referred to as 
parallax) between the position of a point A on the 
object to be photographed 0 on a coordinate of the 
5 standard image 72 and that of the point A on the 

coordinate of the other photographed image 7 OR, 
positions of points of sight, and a sight line 
direction, a distance to the point A can be calculated 
based on a principle of triangulation . Usually, when 

10 the three-dimensional information is acquired by a 

stereo image, stereo matching is performed to recognize 
a point on the other image to which one standard point 
on one image corresponds by corresponding point search. 
Even in this case, in order to acquire various 

15 parameters required for a correct parallax or 

triangulation (relation in positions and postures among 
a plurality of photographing systems in addition to the 
parameters of a single photographing system (camera) ) , 
for example, the calibration pattern 10b shown in 

20 FIG. 2 is photographed. In this case, the parameters 

can also be acquired for parallel projection processing 
(rectification) of the image. 

Moreover, as the stereo converter by which the 
stereo image can be photographed by the photographing 

25 system 44 described above, a stereo adapter 74 shown in 

FIGS. 20A and 20B are known. Here, by the stereo 
adapter 74, the object to be photographed O is 



s 
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photographed from at least two different points of 
sight, and an optical path splitting optical system 76 
is incorporated. Here, for the optical path splitting 
optical system 76, the images of the object to be 
5 photographed 0 viewed from a plurality of points of 

sight are guided into the photographing optical system 
50 of the photographing system 44, and accordingly the 
image of the object to be photographed O from the 
different points of sight is formed in the image pickup 

10 device 38 of the photographing system 44. That is, the 

optical path splitting optical system 76 includes two 
light receiving mirrors 78 disposed apart from each 
other, and two deflecting mirrors 80 disposed before 
the photographing optical system 50. The image of the 

15 object to be photographed reflected by the light 

receiving mirrors 78 is incident upon the photographing 
optical system 50 by the deflecting mirrors 80, and the 
image from two different points of sight can be formed 
in the image pickup device 38. Accordingly, the stereo 

20 image is obtained from the image pickup device 38. 

FIG. 21 is a diagram showing the photographing 
situation of the calibration pattern by the 
photographing system 44 which is the photographing 
apparatus according to the tenth embodiment. That is, 

25 to photograph the calibration pattern (calibration 

pattern 10b in this example) is photographed by the 
photographing system 44 including the electronic finder 
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4 6 to which the stereo adapter 74 for photographing the 
stereo image has been attached, the marker for 
positioning (marker for positioning 14d in this 
example) is electronically superimposed/displayed on a 
5 stereo image 48d displayed in the electronic finder 46. 

Since the user uses the superimposed/displayed 
marker for positioning as the clue to photograph the 
calibration pattern, it is easy to grasp the pattern in 
the appropriate view field of the photographing system. 
10 When the calibration pattern is photographed by the 

stereo photographing, the present invention can also be 
applied for acquiring various parameters of the 
photographing optical system 50 of the photographing 
system 44. 

15 It is to be noted that, needless to say, each 

constitution of the embodiment of the present invention 
can variously be modified/changed. For example, the 
marker for positioning may also be displayed only in a 
certain image (e.g., the left-side image) in the left 

20 and right images constituting the stereo image 48d as 

shown in FIG. 21, or may also be displayed with respect 
to both the images. Not all the photographed stereo 
images 48d but only one of the left and right images 
may also be displayed in the electronic finder 46. 

25 Furthermore, to photograph the stereo image, instead of 

using the stereo adapter 74, a plurality of 
photographing systems 68L, 68R shown in FIG. 19 may 
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also be used. 

Additional advantages and modifications will 
readily occur to those skilled in the art. Therefore, 
the invention in its broader aspects is not limited to 
5 the specific details, representative devices, and 

illustrated examples shown and described herein. 
Accordingly, various modifications may be made without 
departing from the spirit or scope of the general 
inventive concept as defined by the appended claims and 
10 their equivalents. 



